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A system for and method of displaying information 



The invention relates to a system for displaying information on a display 

device 9 comprising: 

- receiving means for receiving a transport stream comprising services, with 
the services having elementary streams of video and of data-elements; 

5 - user interface means for making a user selection of a type of information to 

be displayed on the display device; 

- a filter for selecting a first data-element of a first one of the services on basis 
of the user selection; 

- rendering means for calculating an output image to he displayed on the 
1 0 display device, on basis of the first data-element seleoted by the filter; and 

- switching means for switching from the first one of the services to a second 
one of the services. 

The invention further relates a method of displaying information on a display 
device comprising the steps of: 
15 - receiving a transport stream comprising services, with the services having 

elementary streams of video and of data-elements; 

- user actions of making a user selection of a type of information to be 
displayed on the display device; 

- filtering to select a first data-element of a first one of the services on basis of 
20 the user selection; 

- rendering to calculate an output image to be displayed on the display device, 
on basis of the first data-element selected by the filter; and 

- switching from the first one of the services to a second one of the services. 
An embodiment of the system of the kind described in the opening paragraph 

25 is known as set top box A set top box is linked to a Digital Video Broadcast (DVB) server by 
means of a broadband network and optionally by means of a second network, primarily for 
data flow from the set top box, Typically the broadcast server and the set top box are in 
compliance with a standard, e.g. Multimedia Home Platform (MHP)i The Broadcast server is 
responsible for generating a transport stream, e.g. an MPEG-2 transport stream comprising 
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video, audio and data. The data comprises application data, Le. software code representing an 
application to be run on the set top box, and data to be processed by such an application. A 
set top box provides its output to a television. Optionally the set top box is integrated into the 
television. The set top box is arranged to receive the u-ansport stream and to select one of Hie 
5 services. Typically a service comprises mutually related elementary streams of video, audio 
and data. E.g. a video stream of a service represents a sequence of images being captured of a 
football match. Optionally mere is a further video stream which represents another sequence 
of images being captured of the football match from another point of view. An audio stream 
corresponds to the sound being captured in the stadium of this football match and another 
10 audio stream corresponds to the voice of a reporter. The data is also related to football. The 
data of the data stream might correspond to the actual situation of the match, e.g. the score, 
who made the goals and when, the number of yellow and red cards, the current players of me 
teams, etcetera. The data might also correspond to other aspects of football, e.g. the 
tournament schedule, statistical infoimation on teams and players, etcetera. 

The set top box comprises means to select a service from the transport stream. 
The set top box further comprises user interface means for making a user selection of the type 
of information to be displayed on me television. Typically this works by means of a graphical 
user interface which is the visible part of an application. The user is provided with menus of 
options corresponding to information which is available in the elementary data stream of the 
selected service. By browsing through the menus and by selecting an option the user defines 
which type of data, i.e. which data-elements, should be selected from this elementary data 
stream which has been partly received and is partly to be received, by the set top box. A 
visual representation of the selected data-elements is then displayed on the television. E.g. 
"Team A-Team B : 0-2". The user can switch to another service for which be can also select 
25 information to be displayed, by means of browsing and selecting provided options. In the 
latter case the provided options relate to the most recently selected service. 

It is an object of the invention to provide a system of the Idnd described in the 
opening paragraph which is more user friendly. 

The object of the invention is achieved in that the system is designed to apply 
the filter for selecting a second data-element of the second one of the services, on basis of the 
user selection, when being switched from the first one of the services to the second one of Ihe 
services, with the first data-element and the second data-element being mutually semantically 
related and to apply the rendering means for calculating the output image to be displayed on 
me display device, on basis of the second data-element selected by the filter. The user does 
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no t have selection .tec being switched from to first service to the second 

^ce T*^(**xm^~^»^^ tm +* mBimm *" > "* 
define which type of Information he is interested fa. The user selection being made on basis 
of rhe provided option, «hue the first service vk* selected, k used to select to apjrcoprraie 

' different services ofteuhave to seme informsnon model, i.e. date tnodel. That else -teens 
(hat various content providers share one intonation model or make use of stonier 

io&imatioa models. 

An embodiment of me system according to me invention is designed to apply 

0 t^fi^forselecimgt^ 

services to the second one of the services, with the data-element and the second data-element 
being mutually ^mantically equal. Preferably the dat^lement and me second data-element 
^ also syntactically equal. ^ working of mis embodiment will be explained by means of 

l5 T^**^^>^*^*^«^ M ^r*?T* 

* data-elements which are classified willi label "Score" are filtered from the incoming data- 
elements belonging to the first service. The current score of 'die football match, which is 
broadcast viathe first service, is displayed cn the display device. After being switched* a 
second service, corresponding to another football match, ^elements which ate classified 
20 with label -Score" are filtered from the incoming data-elements belonging to the second 

service. Now me current score of the other football match, which is broadcast via the second 
service ,is displayed on the display device. 

Another embodiment of the system according to the invention comprises a 
converter for controlling the filter to select the second data-element on basis of tltf user 
25 selectionandathtrddata-e^ u 
embodiment willbe explained by means of an extension of the example above. Suppose that 
the user has selected the option "show actual score" while watching a football match bemg 
provided by means of the first service. The result is mat data-elements which are classified 
with label "Score" are filtered from the incoming data-elements belonging to the first service. 
30 Now the user switches to the second service, which comprises streams of video, audio and ^ 
dataof atennis game. In this latter data stream there are no data-elements with label "Score . 
However there are data-elements with label "tennis" and there are data-elements with labels 
"Scores" The converter is able to map "Score" to "Scores" on basis of a data-element with 
label "tennis". This embodiment of the system according to the invention is advantageous in 
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the case that different services do not have the same information model but that it is possible 
to map a data type of a first information model into a data type of a second information 
model. 

In an embodiment of the system according to the invention, the rendering 
5 means are arranged to calculate a mixed output image to be displayed on the display device, 
on basis of the selected data-element and a first image of a first elementary stream of video. 
Preferably the graphical representation of the data-element is displayed as an overlay on the 
input images of the video stream. 

An embodiment of the system according to the invention comprises storage 
10 means for storage of a parameter which determines the filter. The advantage of this 
embodiment is that the properties of the filter are made persistent, After a restart of the 
system or application the same filtering operation can be performed. 

An embodiment of the system according to the invention is arranged to run an 
application, which enables in making the user selection and of which software code is being 
15 exchanged by means of a first elementary stream of data-elements. By exchanging the 

software code via the transport stream, it is possible to have up-to-date software at the cHent 
side of the network, i.e. in the system, e,g. set top box. This is especially important in the 
case of modifications of an information model and for the converter. 

An embodiment of the system according to the invention comprises the 

20 display device. The system might comprise a separate set top box and television. But 
preferably these two are integrated into one unit 

It is a further object of the invention to provide a method of the kind desoribed 
in the opening paragraph which is more user friendly. 

This object of the invention is achieved in that the method of displaying 
25 information on a display device is characterized in comprising a second step of filtering to 
select a second data-element of the second one of the services, on basis of the user selection, 
when being switched from the first one of the services to the second one of the services, with 
the first data-element and the second data-element being mutually semantically related and a 
second step of rendering to calculate the output image to be displayed on the display device, 
30 on basis of the second data-element selected by the filter. 

Modifications of the system and variations thereof may correspond to modifications and 
variations thereof of the method described. 
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invention will become apparent from and will be elucidated with respect to the 
implementations and embodiments described hereinafter and with reference to the 
accompanying drawings, wherein: 
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Fig, 1 schematically shows an embodiment of the system according to the 
invention in its context; and 

Fig. 2 schematically shows components of an embodiment of the system 



according to the invention. 

Coixesponding reference numerals have same or like meaning in all of the Figures, 
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Fig, 1 schematically shows an embodiment of the system 100 according to the 
invention in its context. The system 100 has a number of connections with other systems 102 
and 110: 



broadband network 1 06. The broadcast server 110 is responsible for providing the transport 
streams to the broadband network 106. 

- The system 100 is connected to a television 102 which comprises a display 
device 104. Video and audio content and data being exchanged via the system 100 are 

20 displayed on tbe television 102. 

- The system 100 is optionally connected to a broadcast server 1 10 by means 
of a second network 108, e.g. Ethernet. . This second network is primarily used for data 
exchange from the system 100 to e.g. the broadcast server 1 10, 

The broadcast server 110 comprises a first storage means 1 12 for storage of 
25 video and audio content being provided by means of input connector 120. The broadcast 
server 1 10 also comprises a second storage means 1 14 for storage of data. This data 
comprises application data, i.e. software code which is the base of an application to be run on 
the system 100, and of data to be processed by the application. The video and audio content 
are multiplexed with the data by means of multiplexer 1 16. The resulting transport stream is 
30 modulated by means of the modulator 118 which is designed to convert the transport stream 
to a higher frequency such that it can be transmitted on the broadband network 106 (e.g. 
terrestrial or satellite). 



15 



- The system 1 00 is connected to a broadcast server 1 10 by means of a 
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Fig. 2 schematically shows components 202-208, 222-224 and interfaces 212- 
216 of an embodiment of the system 100 according to the invention. The system 100 
comprises: 

- receiving means 202 for receiving transport streams being provided on the 
S input connector 214. A transport stream comprises services. A service comprises elementary 

streams of video, audio and of data-elements; 

- user interface means 220 for making a user selection of a type of information 
to be displayed on the display device 104. Preferably the user interface means comprise a 
remote control unit 220. The signals sent by the remote control 220 are received via input 

10 sensor212. Another part ofthe user interface means is the display device 104ofthe 
television 1 02. Use is made ofthe so-called On Screen Display feature (OSD). Via the 
display device 104 the user is provided with graphical representations 218 ofthe data- 
elements; 

- switching means 204 for switching from a fast one ofthe services to a 
second one ofthe services. Switching might mean that new application data is downloaded to 
be run. But it is also possible mat one and the same application is handling multiple services. 

- a filter 206 for selecting data-elements ofthe first one ofthe services on basis 
ofthe user selection made by the user, Note that multiple data-elements related to the same 
information are sent. E.g. assume that the information is the current score of a live football 
match. As long as the score equals "0-1" data-elements are exchanged, e.g. every second, 
containing this information. However, if a goal has been made the situation is changed and 
from that moment on data-elements will be exchanged reflecting the new situation, e.g. data- 
elements representing the score with value M 0-2". 

- rendering means 208 for calculating graphical representations of data- 
25 elementstobedisplayedottthedisplaydevice 104, on basis of output ofthe filter 206; 

- an Ethernet connector 216 for exchange of information from the system 100 
back to e.g. the broadcast server 1 10; 

- a video processor 222 for processing the video stream. Eventually the 
graphical representations of data-elements are merged with the input images ofthe video 

30 stream resulting in a series of output images to be displayed on the display device 104. The 
rendering means 208 are arranged to merge these. The signal representing these output 
images is provided to the input connector 210 ofthe television 102. 
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- an audio processor 224 for processing the audio stream, The signal 
representing the processed audio stream is provided to the input connector 21 1 of the 
television 102. 

The working of the system 100 according to -fee invention will be explained by 
means of examples. It is assumed that the data-elements being exchanged from broadcast 
server 110 to the system 100 are conform a predefined information model. Table 1 comprises 
a part of such an information model. Each row of Table 1 belongs to a separate data type. The 
first column corresponds to a unique identification of each datatype. The second column 
corresponds to the name of the datatype. The third column corresponds to the type of the 
dat^ type. In. the fourth column a description of the data type is given and in the fifth column 
an example of the data type is given. 



15:2 



Table 1: specification of data-elements: 



Identification 


Name 


Type 


Description 


Example 


0000 


Score 


Integer array 


Current score of sports game 


2,3 


0001 


HalfScore 


Integer away 


Score of sports game after half 
playing time 


0,0 


0002 


FinalScore 


Integer array 


Score of sports game after full 
playing time 


3,4 


0003 


Goaltimes 


Integer array 


Moments of time of the goals 


12,34,56 



15 Suppose that a user has selected a first service of the transport stream. This 

service corresponds with a football match between teams A and B. The user is interested to 
be informed about the current score of the match. Via the remote control 220 of the system 
the user provides a command to show which type of score information is available in the first 
service. The result of this command is that the application running on the system 100 creates 
20 a graphical overlay, which is mixed with the input images of the video stream, by means of 
the rendering means 208. The final output images are displayed on the display device 104 of 
the television. These output images comprises the following text: 
"What do you want to be shown?" 
-"Current score" 
25 - "Score after half playing time 5 " 

- "When were the goals made" 
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The user indicates that only the cuirent scote should be displayed. As a result, from now on 
the filter 204 -will fetch all data-elements of the data stream with the ri$xt type, i.e. with 
identification 0000 and with name "Score" (See Table 1). Data-elements which do not have 
this type will be skipped by the filter. A graphical representation of the current score will be 
5 displayed on the display device 104. Note thatthe values of the series of incoming data- 
elements might be mutually different, e.g. "0-0", "0-1", "1-1", etcetera. 

After a while the user switches to another service, e.g. corresponding to a 
movie. In the elementary streams corresponding to this service there are no data-elements 
with the type corresponding to "Score". Hence there will be nothing displayed about football 
10 scores. 

Then the user zaps further to a third service which corresponds to a football 
match between team C and team D. In (he elementary streams corresponding to this third 
service there are data-elements with the type corresponding to "Score". The filter 204 will 
fetch these date-elements and a graphical representation of the current score of the match 
15 between team C and D will be displayed on the display device 104. 

Up till now the data-elements were considered as independent information 
entities. However in most cases data-elements are structured, e.g. in modules or objects. A 
common approach of modeling is based on objects being specified by their data-elements and 
the parents and child they have. In such a way a so-called object tree can be defined. For 
20 instance a tree with as root "sports". The children of the root-object are "tennis" and 
"football". The children of the "footfcalP-object are "World championship", "European 
championship" and "Dutch championship", The children of me "Dutch ohampionship"-object 
are "schedule", "team" and "results" The "team"-object comprises "pIayer"-objects and 
"coach"-object In Table 2 some data-elements of the "player"-object, having a "football"- 
25 object as ancestor, are specified. 



Table 2: specification of data-elements of "player" object for "football": 



Identification 


Name 


Type 


Description 


Example 


1000 


FirstName 


String 


Family name 


Jansen 


1001 


NiclcName 


String 


Nick name 


Speedy "~ 


1002 


Age 


Integer 


Age 


25 


1003 


Interlands 


Integer 


Number of international games 

played 
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For tennis a similar object definition is made, but which is slightly different. 

See table 3. 



Table 3; specification of data-elements of "player" object for "tennis": 



Identification 


Name 


Type 


Description 


Example 


2000 


FirstName 


String 


Family name 


Jansen 


2001 


NickName 


String 


Nickname 


Speedy 


2002 


Age 


Integer 


Age 


25 


2003 


Tourname 
jits 


Array of 
Strings 


International tournaments won 


Wimble 
don 



5 

Suppose that the user A watching the football match, between team A and B had 
indicated to display the information of the players. Then the user switches to a service 
corresponding to a tennis game. The tesult will be that the information comprised by the 
"player"-objects of teonis will be displayed. Hence, the number of international games played 

1 0 will not be shown but instead the international tournaments won will be listed. This can be 
realized in several ways, A first approach is based on filtering on a data-element related to a 
'^layers-object Another approach, is based on a mapping table in which is specified that . 
data-elements with identification 1003 (Interlands) must be mapped to 2003 (Tournaments). 
This mapping can be realized by a so-called converter. 

15 Not only for sports but for every type of service an information model can be 

made. Even by switching from a sport service to a movie service,, the filter defined while 
watching the first service, can be reused. By means of example the "aotor^object of a movie 
is given in Table 4, So switching from football to a movie might mean that a data-sheet of an 
actor currently visible is provided too. This is because the converter maps a "player"-<object 

20 to an "actors-object 



PHNL020230EPP 



10 



078 11.03.2002 
11.03.2002 



Table 4: specification, of data-elements of "actor" object for "movie" 



Identification 


Name 


Type 


Description 


Example 


3000 


FirstName 


String 


Family name 


Nickelson 


3001 


NioKName 


String 


Niek name 


Speedy 


3002 


Age 


Integer 


Age 


25 


3003 


Movies 


Array of 
Strings 


Played in these movies 


Shining 



It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention and that those skilled in the art will be able to design alternative 
embodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be constructed as limiting the claim. 
The word 'comprising' does not exclude the presence of elements or steps not listed in a 
claim. The word "a" or "an" preceding an element does not exclude the presence of a 
plurality of such elements, The invention can be implemented by means of hardware 
comprising several distinct elements and by means of a suitable programmed computer. In 
the unit claims enumerating several means, several of these means can be embodied by one 
and the same item of hardware. 
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CLAIMS: 



l t a system (100) for displaying information on a display device (104), 

comprising: 

- receiving means (202) for receiving a transport stream comprising services, 
with the services having elementary streams of video and of data-elements; 



information to be displayed on the display device (104); 

- a filter (206) for selecting a first datandement of a first one of the services on 

baste of the user selection; 

- rendering means (208) for calculating an output image to be displayed on the 
10 display device (104), on basis of the first data-element selected by the filter (206); and 

- switching means (204) for switching from the first one of the services to a 
second one of the services, characterized in that the system (100) is designed to apply the 
filter (206) for selecting a second datarelement of the second one of the services, on basis of 
the user selection, when being switched ftom the first one of the services to the second one of 

15 the services, with the first data-element and the second data-element being mutually 

semantieally related and to apply the rendering means (208) for calculating the output image 
to be displayed on the display device (104), on basis of the second data-element selected by 
The filter (206). 

20 2. A system (100) as claimed in Claim 1, characterized in that the system (100) is 

designed to apply the filter (206) for selecting the second data-element, when being switched 
from tiie first one of the services to the second one of the services, with the data-element and 
the second data-element being mutually semantieally equal. 



5 



- user interface means (220) for making a user selection of a type of 



25 



3. a system (100) as claimed in Claim 1, characterized in comprising a converter 

for controlling the filter (206) to select the second data-element on basis of the user selection 
and a third data-element of the second one of the services. 
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4. a system (1 00) as claimed in Claim 1 , characterized in that the rendering 
means (208) axe arranged to calculate a mixed output image to be displayed on the display 
device (104), on basis of the selected data-element and a first image of a first elementary 
stream of video- 

5 

5. A system (1 00) as claimed in Claim 1 , characterized in comprising storage 
means for storage of a parameter which determines the filter (206). 

6. A system (100) as claimed in Claim 1, characterized in being arranged to run 
10 an application, which enables in malcing the user selection and of which software code is 

being exchanged by means of a first elementary stream of data-elements. 

7. A system (100) as claimed in Claim 1, characterized in comprising the display 
device (104), 

15 

8. A method of displaying information on a display device (104) , comprising the 
steps of: 

- receiving a -transport stream comprising services, with the services having 
elementary streams of video and of data-elements; 

20 - user actions of making a user selection of a type of information to be 

displayed on the display device (104); 

- filtering to select a data-element of a first one of the services on basis of the 

user selection; 

- rendering to calculate an output image to be displayed on the display device 
25 (1 04), on basis of the first data-element selected by the filter (206); and 

- switching from the first one of the services to a seoond one of the services, 
characterized in comprising a second step of filtering to select a second data-element of the 
second one of the services, on basis of the user selection, when being switched from the first 
one of the services to the second one of the services, with the data^element and the second 

30 data-element being mutually semantically related and a second step of rendering to calculate 
the output image to be displayed on the display device (104), on basis of the second data^- 
element selected by the filter (206). 
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A system (100) for displaying information on a display device (104) 
comprises; receiving means (202) for receiving services; user interface means (220) j* 
making a user selection of a type of information to be displayed on the A — f 

^filter (206) for selecting a data-element of afirst one of the services onbasis of the 
selection; and rendering means (208) for calculating an output Image to be displayed 
display device (104), on basis of output of the filter (206). The system (100) xs 
apply the filter (206) for selecting a second data-element of the second one of the 
basis of the user selection, when being switched from the first one of the services to , 
one of the services, with the data-olement and the second data^element being mutual 
seroanticaUy related. 



i display device (104); 

user 
mthe 
designed to 
services, on 
second 
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